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(54) Giobai rate coritrol for modei-assisted video encoder 



(57) A meiiiod and apparatus for coding an imaga 
co'TiprlsIng (at least) two regions [e.g., a facial rsgion 
and a baciiground region) which are to be coded with 
different quantization error parameters [e.g., quantizer 
step sizes), wherein the respective quantization error 
pararrteters ars determined with use of a fesd-forward 
rate control technique Initial quantization error param- 
eters are assigned to each region, and lhs oversii bll 
rate >/ifi-iich would result for the coding of the given frame 
is computed based on these assigned quantization error 
parameters. The computed bit rate is compared to a giv- 
en bit rate conislralnl which may, for example, represent 
a limitation of a transmission channel. Based on the re- 
sult of this comparison, one or both of the assigned 



quantization erior pararrieters are adjusted, thereby re- 
Siuhing ifi (Jilferent Cjija.ntizatiori ei ror parameters for the 
two regions. For example, if the computed bit rate ex- 
ceeds the given bit rats constraint, at ieast one of the 
quantization error parameters is advantageously adjust- 
ed in a direction which results in !he use of fewer coding 
bits (e.g.. a coarser quanlizaiion}. If the given bi! rats 
constraint exceeds the computed bit rate, at least one 
of the quantlzalio.", error pai-amelers is sdvantagsoLisly 
adjusted in a direction which results in the use of more 
coding bits (e.g., a finer quantization resulting in ahigher 
coding quality), rinaily, each of the regions is coded 
based on the correspondingly assigned quantization er- 
ror parameters. 
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Description 

FieSd onhe lnveniiort 

The present inveniion relates to the field of video 
sigria! coding and more particularly to the coding of vid- 
eo signals for use in video communications at low bit 
rates. 

Background of the Invention 

The coding of video signals for efficient transmis- 
sion and/or storage has received a great deal of recent 
attention, particularly vvitli the groi,ving interest in tech- 
nologies such as HDTV (High Definition Teiavision) arid 
interactive TslGvision (e.g., "video-on-demand"). In fact, 
video coding algorithms have been standardized for 
many of these applications (including, e.g., iViotion Pic- 
ture Experts Group standards such as MPEG-1 and 
MPEG~2). These applications, however, typically in- 
volve the coding of video signals at relatively high bit 
rates. 

At low bit rates, such as are used in video telecon- 
ferencing and video lelephariy appilcations, coding ar- 
tifacts are often present throughoul the coded iiragos. 
These artifacts result from the fact thai having a iow 
number of bits available to code each frame reduces the 
quality of the coding that can be performed. Typically, 
the artifacts tend to affect various areas of the image 
wrhhoul discrimination. Viewers, however, tend to find 
coding artifacts to be much more noticeable in areas of 
particular interest to them, in typical video teleconfer- 
encing or telephony applications, for example, Ihs view- 
er will tend to focus his or her anention to ine face(s) of 
the person(s) on the screen, iather than to other areas 
such as clothing and bacl^ground. Moreover, even 
though fast motion in a coded image is known to mask 
coding artifacts, the human visual system has the ability 
to "lock on" and "track" particular moving objects in a 
scene, such as a person's face. For the above reasons, 
communication between users of very low bit rate video 
teleconferencing and telephony systems tend to be 
more intelligible and psychologically pleasing to the 
viewers when facia! features are not plagued with too 
many coding artifacts. 

In "Modsi-Assistsd Coding of Video Sequences at 
Low Bit Rates" (EP-A-06847o6) ii vvas recognized that 
in video teleconferencing and telephony applications, 
for example, the coding quality of certain regions of a 
video image (e.g., those containing a predetermined ob- 
ject such as a person's face) is significantly more impor- 
tant than the coding quality of other areas of the scene. 
In particular, and in accordance with an illustrative em- 
bodiment of the invention disclosed therein, a region of 
an image which includes a predetermined object such 
as a person's face may be aulomaticaiiy determined by 
comparing one or more predetermined (geometric) 
shapes (e.g., ellipses of various dimensionality) with the 



shapes of objects found in the image. That is, the pre- 
determined object is "modelled" by a set of one or mora 
geometric shapes When a good "match" is found, it may 
be presumed that the object in the image is, in fact, the 

s predetermined object (e.g., a person's face). The deter- 
mined region, presumed to include the predetermined 
object, may then be coded with, for example, a higher 
quality coder than might be used for coding other areas 
of the image. "Model-Assisted Coding of Video Se- 

?o quences at Low Bit Rates" is hereby incorporated by ref- 
erence as is fully set forth herein. 

in video coding applications based on the well 
known fvlolion -Compensated Discrete Cosine Trans- 
form (MC-DCT) technique, a "rate control module" is re- 
's sponsible for assigning quantizers or quantization levels 
(ir! the case of uniform scalar quantization) to image 
blocks, given a bit budget. Such rale control algorithms 
are usually classified In two broad classes: feed-back- 
ward and feed-forward algorithms. (See, e.g., "3it-iate 

20 control for iv^PEG encoders," by G. Keesman, I. Shah, 
R. Klein-Gunnewiek, image Communication, vol. 6, pp. 
545-560, 1995.) In feed-backward rate control, a limited 
knowledge ot the relation between qijaritizer step size 
and bit rale ie availabie A bu^ei is used to regulate 

^ quantization as in the H 261 standard {Reference inn- 
plementation RMS], and as described in "fviodei-Assist- 
ed Coding ot Video Sequences at Low Bit Rates." This 
approach can result in fiuctiiaiions in image quality 
'Miich are e£;f)eciaily ijnaesirable within a region of in- 

30 terest such as a facial region. In feed-forward rate con- 
trol, the exact relation between a quantizsrstep size and 
bit rate is assumed to be available. Based on this rela- 
tion, an optima! bit allocation can, in theory, be cotnput- 
ed exactly However, tnis relation is ijsually obtained i\\ 

3& "m expense of an extensive analysis phase involving 
considerable trial-and-error. Algorithms in this class are 
therefore usually deemed too complex for practical im- 
plementations. 



The present invention provides a method and ap- 
paratus for coding an image (e.g., a frame of a video 

■^s cia! region and a background region) which are to be 
coded with different qtianiizatlon error parameters [a.g , 
quantizer step sizes), wherein the respective quantizci- 
tlon error parameters are determined with use of a feed- 
forward rate control technique. Specifically, in accord- 
so arics with an illuslralive embodimenl of Ihe present in- 
vention, initial quantization error parameters are as- 
signed to each region, and the overall bit rate which 
would result for the coding of the given frame is com- 
puted based on these assigned quantization error pa- 
ss rEimeters. The computed bit rate is compared to a given 
bit rate constraint which may, for example, represent a 
limitation of a transmission channel. Based on the result 
of this comparison, one or both of the assigned quanti- 
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zation error parameters are adjusted, thereby resulting 
in differGnt quantization error parameters lor tlis two re- 
gions. For example, if ti-ie computed bit rate exceedslhe 
given bit rale conslrfiin!, at leasi one of the quanlization 
error parameters is advanfageousiy adjusted in a direc- 
tion which results in the jse o; fewer coding bits {e.g., 
a coarser quantization), if, on the other hand, the given 
bl! rate constraint exceeds the computed bit rate, at least 
one of the quantization error parameters Is advanta- 
geously adjusted in a direction which results in the use 
of more coding bits {e.g., a finer quantization resulting 
in a higher coding quality). Finally, each of the regions 
is coded based on the correspondingly assigned quan- 
tlzatior! error parameters. 

in one iilustrailve erribodiment of the present Inven- 
tion, tho inodification oi ;he one or more assigned quan- 
tization srror parannelers is performed by an iterative 
process whereby the parameter assigned to one of the 
regions is adjusted until either the result of the afore- 
mentioned comparison changes (to approximate equal- 
ity), or until ehhsr parameter reaches a limiting value. 
The limiting value may comprise a predetermined max- 
imum or minimum value, or it may be based on a prs- 
deteriTiiried maximum aiiovvable difference between the 
v,-akifir) of ihe quantization error parameters tor the tv^'o 
regions. In parilcular, it the computed bit rate exceeds 
the given bit rate constraint, the quantization error pa- 
rameter of the background region may be advanta- 
gsoutsly adjusted in a direction which results In the use 
of fewer coding bits {e.g., a coarser quantization), 
whereas if the given bit rate constraint exceeds the com- 
puted bit rate, the quantization error parameter of the 
facial region may be advantageously adjusted in a dl- 
fection whicfi results in the use of more coding bits (e 
g., a finer quantization), in this manner, a high coding 
quality in the facia! region will be maintained wherever 
possible In view of the bit rale constraint. 

In the case where the quantization error parameter 
reaches a limiting value, the parameter assigned to the 
other region is then advantageously adjusted iteratively 
(either alone, or alternately along with the parameteras- 
slgned to the first region In the case that the limiting val- 
ue was based on a predetermined maximum allowable 
difference therebetween), until the re-sult of the compar- 
ison changes (to approximate equaiily}. In this manner, 
the highest quality coding possiblo is prcxiucsd in the 
faoiai region, while the constraints of the available bit 
rate, the minimum and maximum acceptable levels of 
quantization, and, if applicable, the predetermined max- 
imum allowiable difference between the parameters are 
all met simultaneously therewith. 

Brief Description oi the Drawings 

Figure 1 lllustrEites a block diagram of an illustrative 
system tor compressing video data which may be em- 
ployed In accordance with the present invention. 

Figure 2 illustrates a flow diagram of an iiiustratlvs 



method for compressing video in accordance with the 
present Invention, as may, for example, be Implemented 
in video processor 102 of the illustrative system of Fig- 
ure 1. 

5 Figure 3 shows a block diagram for an illustrative 
low bit rate video source coder based on Motion-Com- 
pensated DIscrsts Cosine Transform (MC-DCT) tech- 
niques 

Figure 4 shows an illustrative segmentation of an 
<o image into a facial region (a region-of-interest) and a 
non-facial region. 

Figure 5 shows an example of an identified reglon- 
ot-intere-st in an Illustrative Input image, with a horizontal 
line of Image macroblocks shown traversing the region- 
's of-interest. 

Figure 6 shows an Illustrative quantization profliss 
corresponding to the example of Figure 5 which may be 
used In an illustrative embodiment of the present inven- 
tion. 

20 Figure 7 shows an example of a differential quanti- 
zation (DQUANT) table with differential quantization val- 
ues and DQUANT codes which may iilustrailvsiy be 
used to encode such values. 

Figuie S shows a (low diagram of a global rnodel- 

^5 assisled rate control method in .-iccordance with a first 
illustrative embodiment of the present Invention. 

Figure 9 shows a block diagram of an Illustrative en- 
hancement to the global model-assisted rate control al- 
gorithm In accordance with the first Illustrative embodi- 

30 ment of the present Invention as shown In Figure a, the 
enhancement providing for variable frame rate type rate 
control. 

Figur(; 1 0 shows a flow diagram of a method for per- 
forming glota,-;il model-assisted rate control In accord- 
s' anc8 With a second illustrative embodiment of the 
present invention. 

Figure 11 shows an illustrative flow diagram for per- 
forming the update function of block 615 of the global 
model-assisted rate control method in accordance with 
40 the second illustrative embodiment of the present inven- 
tion as shown in Figure 10. 

Detaifed Description 



Figure 1 depicts an illustrative system for com- 
pressing vkleo data which may be employed In accord- 
ance with the present invention. Camera 101 captures 

so video data and transfers it to video processor 102. The 
video processor, using software stored In SRAM 103, 
may be used to implement a compression algorithm in 
accordance with certain illustrative embodiments of the 
present invention. The final compressed bitstream may, 

ss for example, be stored In SRAM 103 from which Chan- 
nel Interface 1 04 reads the compre.ssed data and maps 
it onto communications channel 107. At the same time, 
the system decompresses the data and stores the re- 



introduction 



3 



5 



EP 0 785 689 A2 



6 



suits in DRAM 106 for dlspiay on dispiay unit 105. 

Figure 2 illustrates a flow diagram of one liiustratlve 
riiethod for compressing video in accordance wifli liia 
prfBiserit invention, as nay, for example, be implernentad 
in video processor 102 of tlie illustrative system of Fig- 
ure 1. 1 n block 201, the frame of video io be compressed 
is read from memory. In biock202, the frame is prsdiclsd 
from 1h£s previous frame using convsnlionai motion es- 
timation techniques. In blocit 203, the difference from 
the predicted frame and the frame to be transmitted (the 
'residual') is computed, in block 204, the residual is bro- 
ken into a rectangular array of M by N macroblocks, 
each illiisiratively of size 16 by 16 pixels, in Block 20.5, 
a region of Interest is identified (such as, for example, a 
face, hands, impcilant objects, etc.), and the maciob- 
locks are divided into two groups ■ ■ those belonging to 
thfi region of interest, and those not in the region of in- 
terest. The region of inters.?! may be defined, for exam- 
pis, as the facial area as identified by techniques such 
as those described in "Model-Assisted Coding of Video 
Sequences at Low Bit Rates." 

In block 206, the rate control function, which oper- 
ates according to the principles of the present invention, 
assigns a quantization error parameter which illustra- 
tively comprises a quantization slep si?a (also some- 
times referred to merely as a "quantizer"), Qp, to each 
macrobiock. In block 207, the actual quantization is per- 
formed. In block 20S, the quantized blocks are coded 
and transmined to the decoder, in block209, the decode 
operation {i s., essenliaily the same operation as Is per- 
formed by the decoder) is performed to generate a new 
FGConstructed image, which will subsequently be used 
as the previous frame in the predictive coding of the next 
frame. 

A First Illustrative Embodiment 

Figure 3 shows a block diagram for an illustrative 
low bit rate video source coder based on conventional 
Motion-Compensated Discrete Cosine Transform (MC- 
DCT) techniques, such as those complying with ITU-T 
Recommendation H.263 for video coding at rates below 
64 kbps (kilobits per second). (See ITU-T Study Group 
15, ''Draft rsoommendation H,263: Vdsc coding for low 
bitrate comrni.inlcailori,'' Dect-mber 5 1995.) The illus- 
trative coder of Figure 3 may, for example, be used in 
the Implementation of video processor 102 of the illus- 
trative system of Figure 1 . A face tracking module such 
as the one described In "Model-Assisted Coding of Vid- 
eo Sequences at Low Bit Rates" may be used to imple- 
ment face location identifier 321 to provide face location 
information to coding control module 323, which, inter 
alia, performs rate control In accordance with this first 
illustrative embodiment of the present invention, 

specifically, a current original video image is pro 
vided as input to the illustrative source coder of Figure 
3 along line 301 and to the first input of switch 322 along 
line 302. The rnotion-cornpensated previous recon- 



structed frame is available at the output of prediction 
memory' 327 and is fed to differsncer 320 along lines 

313 and 31 5, A rnotiori-cornpensated difference image 
is formed ai Ihe ouipul of the differencer 320 and is fed 

s to the second Input of switch 322 along line 303. For 
each image macrobiock, illusiratively scanned in a zig- 
zag fashion from the upper-left to the lower-right corner 
of the image, coding control module 323 determines 
whether it is more advantageous to code the image 

<o block in "intra" mode (i.e., by computing OCT coeffi- 
cients for the image block Itself), In which case switch 
322 is placed in the upper position, or In "inter" mode (i. 
a., by computing DOT cosfficients for a motion-compen- 
sated in'iage resldi.iai available at the oiiipijt of differenc- 

'S er 320). in which case switch 322 is placed in the lower 
pa;!t!on. Sv/iich 328 is synchronized with switch 322 
and is therefore subjected to the sjime control. The data 
block at the output of switch 322 is transformed and 
quantized by transform and uniform quantization mod- 

20 uls 324, with the quantization step size controlled In ac- 
cordance with this first embodiment of the present in- 
vention by coding control module 323, (Note that the use 
of both "intra" and "inter" coding techniques are well 
known to those skilled In the aii.) 

The qii;3nti?ed DOT coefficienis oiiiput by quantizer 
324 are also used to recon.struct the next motion-com- 
pensated previous reconstructed frame on lines 313 
and 315. They are first inverse quantized and inverse 
transformed by inverse quantization and Inverse trans- 

30 form module 325 If the data was coded in "intra" mode 
(switch 32S in the upper position), the inverse trans- 
formed data is directly written into prediction memoiy 
327 as ro::onstruc1ed data. If the data was coded in "In- 
isr" mode (switch 328 In the lower position), the inverse 

35 transformed data is first added to motion-compensated 
data from ihe previous reconstructed frame on line 31 3, 

314 and 31 6, by adder 326. In both cases, reconstructed 
(or encoded) data for the current frame is available at 
the output of adder 326. Prediction memory 327 com- 

40 pufes motion vectors for the current original image and 
writes those motion vectors into the bitstream on line 
310. The bitstream data corresponding to block coding 
status, quantization type, quantizer coefficients, and 
motion vectors are each variable length coded (VLC) 

4S by varable length coder 329 and are transtnilted to the 
communication channel on iine 311, (Variable length 
coding techniques, such as, for example, Huffman cod- 
ing and arithmetic coding, are conventional lassiess 
coding techniques well know to those of ordinary skill in 

so the art.) 

As pointed out above, face location Identifier 321 , 
may for e)Kimpie, comprise a system such as the one 
described in "Modei-Assisted Coding of Video Sequenc- 
es ai Low Bit Rales." Such a system identifies elliptical 
ss head outlines and rectangular facial areas containing 
the eyes, nose and mouth of people present in the video 
images to encode. Face location information is sent to 
coding control 323 via line 306. In cases where more 
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than one person's head has been located by tace loca- 
tion IdsntiflGr 321 in the current image to encode, all ta- 
cia! areas may be treated as one region-of- interest A-,, 
which may actuaiiy comprise two or more disconnected 
region portions 401 and 402 as illustrativeiy shown in 
Figure 4. The complementary image region Aq {region 
403} rnay be referred to as the 'non-lace region" or, for 
the sake o! simpiicity, the "background," even though it 
typicpJiy includes scene bacl<ground as well as other 
scene elements such as clothing, arms, bands, etc. 

As in !TU-T Recommendation H.263, quantization 
update inforrnaliort which tells the quantizer win Ich quan- 
tization step to use tor each data block is transmitted 

lDQU/i^ . 1 dd3 

avcJhtk tnhtotiacfi . ji li j i 

H.263 standard uses a smai 4 oniry -ah' ! i i 
embodiments of the present invention nay «dvan!3 ■ 
gsously use a larger table, such as, e.£?., orre coiTipi rsing 
2" entries, provided it Is made available to both the en- 
coder and its corresponding decoder. Illustratively, a 
4-bit {i.e., size 2*) table representing 16 even values of 
DQUANT, uniformly spread in the range from -1 6 to +1 6, 
may be advantageously used, since it allows sunicient 
fiexioility tor model -assisted rats control in accordance 
with various illustrative embodiments of the present in- 
vention to work effectively Such an illustrative table is 
shown, for example, in Figure 7, where the left coiurrin 
lists the differential quantization values and the right col- 
umn lists the DQUANT codes used to encode these val- 
ues in the bitstream. 

Constant Frame Rale (CFR) rate control 

In a constant frame rate mocig of opeialion, input 
video frames ai-e encoded at a predefined, fixed frame 
rate - typically 7 5 or 5 fps (frames per second) when 
coding is to be performed at coding rEiles below 25.6 
kbp.s (kilobits per second). The number of bits available 
per frame, referred to as the "bit budget" per frame, is 
simply obtained by dividing the video bit rate by this fixed 
frame rate. 

Figure 5 snows an example of an identified region- 
of-lnteresi (e.g., a head or face outline) in an lilustrative 
input irnaoe, with a horizontal iine of image rnacfobiocks 
travsrssing the region-of-intsrest. In particular ihs hori- 
zontal line of image macrobiocks. line 503, is indexed 
by integer index i,i, and traverses the identified reglon- 
of-inteiest. region 501 (as well as the background, re- 
gion 502). in Figure 6, an illustrative example of a cor- 
responding desired quantization profile is shown, where 
a measure of block coding quality Q is plotted as a func- 
tion of macroblock number along iiorizontal line Iq of the 
macrobiocks. The two numerical values which definy 
the plateau in this profile may be advantfigeously re- 
quired to remain the same when scanning lines of image 
blocks from top to bottom. Of course, the extent ot the 
plateau varies as the horizontal line of macrobiocks 



moves from top to bottom (and where no region of in- 
terest is traversed by the horizontal line, the plateau 
may tor that particular horizoruai iine, be non -existent). 

s tained both within the region of interest and also in the 
background (albeit at a lower quality). The measure oi 
block coding quality' may be, for example, related to the 
quantization step size, Qp, used to uniformly quantize 
the image block by the illustrative relation 

10 

Q = Q^^ - Qp , 

wtiere Qp may, for example, be an integer between 1 
ts and 31 (representaiivs of the selected quantizer step 
.si^e), aricJ where Q,^^ £i!:iuai;.- -32 in this case, the goal 
of the rate conlrol aigorilhni is, for aach inptJt frame, to 
arrive at two specific numerical values of the quantiza- 
tion step size Gp referred to as Q| (for the interior or facial 
20 region) and Qg (for the exterior or background region), 
respectively, which two values entirely define the pla- 
teau. 

Figure 3 shows a flow diagram of a global model- 
assisted rate oonltoi method in accordance with a first 

25 illusirativo ernbodirnenl of th3 prcjserii Invenllon. As 
shown in the figure, this first illustrative embodiment of 
the global model-assisted rate control method compris- 
es tvifo embedded loops. The inner loop comprises in- 
crement module S12 for the exterior region, bit budget 

30 compulation module 816 and test 818 The outer loop 
comprises the inner loop with, in addition, increment 
module 81 2 for the interior region with the exterior region 
reset, and test 820. The function "countblts" invoked In 
bit budget computation module 816 oompuies tf;;; 

35 number ot bils required to encode a current predicted 
frame given the quantization parameters Q, (for blocks 
in the facial region) and Qg (to be used for background 
blocks). In this illustrative embodiment, relatively small 
initial values of Q| and are specified in inilialization 

40 module 810. These values are chosen such that their 
difference is a valid entry in the DQUANT Table of Figure 
7. The Inner loop gradually increases the parameter Q^ 
by an increment A.,Q sitch that the difference - Q| is 
the next positive entiy (reading the DQUANT Table of 

45 rigure 7 froin top to bottom) until it reaches a pre-spec- 
ified (reiatively large) rrsaximurn vaiue Qg^^or until the 
bit budget is met. Tne outer loop gradually increases 
both paraiTtetars Qj and Q., by the same small increment 
(e.g., one), untii the bit budget Is met. 

Variable Frame Rate (VFR) rate control 

For "head-and-shoulders" video material coded at 

ss fraiTiE: rtJte type rate control in ordsr to achieve good lip- 
synchronization. However, for more complex video ma - 
terial (e.g., materia! including moving backgrounds and/ 
or scene changes), it may be difficult to maintain fixed 
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frame rate encoding. That is, Xhs metliod as described 
above might not always converge to a bit count within 
the budget. Insuchacase, it is advantageous to be abia 
to resort to a variabie frame rate variant of the above 
method 

Figure 9 shows a bloci^ diagram of an iiiustrative en- 
hancement to the global model-assisted rate control al- 
gorithm in accordance with the first iiiustrative embodi- 
ment of the present invention as shown In Figure 8, the 
enhancement providing for variable frame rate type rate 
control. Variabie frame rate control worlcs in combination 
with the global rate control method described above. 
Maximum quantizer step sizes and a target frame rats 
are initially used to encode each liarns; basyd on ihs 
illustrative global bit alloc-d.n.' . ^ , : . 
above, modifying the quanti^si step h'vaqs as rioeded to 
meet those objecilvss (module 901). The number of 
frames (Sy,) needed to transmit the generated encoding 
bits, plus any bits in excess of the output buffer target 
occupancy (Btj^ge,), are then calculated by module 902 
according to the equal ion 

where! oenotes Ihe iiileger part of the caiculatlon, C is 
the channel bitrate. Nf^, is the number of bits required to 
oodG ihe currari! frama (i.e., frame M), 3^f, is the buffer 
occupancy, and where the input ssjquence Is assumed 
to have been sampled at 30 frames per second. 

As long as consecutive frames can be encoded at 
the required channel iate and within the maximum quan- 
tizer step size values, the sequence is coded at the de- 
sired constant frame rate. When the target bitrate can - 
not be met at the maximum quantizer step size values, 
however, the VFR procedure adjusts the number of 
frames to be skipped as needed to accommodate the 
transmission of the additional bits in that frame. An out- 
put buffer Is maintained to compensate for the coarse 
control of the instantaneous rate by frame skipping. Ad- 
ditional or fewer encoding bits are provided by skipping 
frames which occur at 30 frames per second. Therefore, 
the actual rate is advantageously modified In steps 
equal to the total bitrate dK'Ided by 30. The iliu.s1rative 
VFR procedure advantageously generates a frame skip 
which maintains a target output buffer occupancy so that 
there are always bits to be transmitted at a constant cod- 
ing rate. The buffer occupancy is calculated by module 
903 based on the equation 

=3M + Ny-Sf^xC/30, 

where N == KH. . (Mote thai sirice is the number 
of framGK skipped, frama N Is the next frame to ericods 
alter frame M.j The use of this buffer adds at most 33 
ms of delay given an input frame rate of 30 frames per 
second. 



A second illustrative embodiment 

A second iilustratK'e embodiment of a rate control 
procedure in .accordance with the present invention op- 

i' erates by trying a variety of different quantizers in the 
facial and non-facial regions, starting with the coarsest 
quantization (and thus the lowest bit rats), and gradually 
decreases the coarseness (thus increasing the bit rate) 
until it finds the set of quantizers which causes ihe rate 

<o to just exceed the target (and thereby approximately 
equals the target). The first step in this second illustra- 
tive embodiment may be referred to as "pre-quantlza- 
iion." In particular, it Is computationally advantageous to 
iTiove as rnuc!'; computation out of the main loop as pos- 

'5 slblB, That IS, Gorripuiations are only done once if it is 
p«s;c;it)le to do so. For example, Ihe DOT Is computed 
for each macroblock ("Atielher It be "intra" or "inter" cod- 
ed), and each coefficient is divided by two. The division 
by two is performed because each quantizer results in 

20 the division of each coefficient by 2Qp. Thus, the division 
by two may be advantageously performed ahead of 
time. After this division, ihe largest coefficient Is noted 
and stored. 

Boih iho iacia! and non-faciai (;.a, background) ry- 

macrobiock structure. In addition, of the 31 available 
quantizers, up to eight are selected for use. The eight 
which are chosen is a function of the largest quantizer 
desired, which can range from 1 to 31 . Initially, the non- 

30 facial region is assigned the largest (J.s., coarsest) 
quantizer, and the facial area is assigned the next small- 
est quantizer. Then, if it Is determined that the bit rate 
required for the use of these cjuamizsrs Is loss than the 
target bil rate tor ihe frame, the qiianii.'ftr;; are de- 

35 creased. 

Specifically, the quantizers are decreased in steps. 
In each step, the decr£:-ai>e occiJis iri either the facial or 
non-facial region, and In each region, only the macrob- 
locks In a single strip have their quantizers decreased 

40 in a given step. By changing the quantizers on a strip- 
by-strip basis, high accuracy in meeting a target bit rate 
will result, (If the quantizers could be changed only on 
a reglon-ba-sed granularity, the change in rate for a sin- 
gle step in the quantizer vaiue niiqh; in some cases be 

4S quite large ) 

The quanti^E-is are first adjusied m the bottoin-rrtost 
strip, and then are adjusted for each strip above It, In 
turn. For example, it the facial region were initiaiizeci with 
a quantizer of 1 7, for example, and the non-facia! region 

so were initialized with a quantizer of 1 S, then If ihe rate 
were determined to be beiow the target rate, the mac- 
robiocks in the facial region which He on the bottom-most 
group of blocks will have their quantizer I'educed to 1 5. 
Then, the next row of facial blocks would have their 

ss quantizers reduced to 15, so that now the bottom two 
row-s have all facial blocks using a quantizer of 15, and 
so forth. 

Once all or the mvjs in a given region have had their 
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quantizers decreased, the process begins again at the 
bottom ct the picture. At each pass through the picture, 
the decision ;o dscrease the quantizers in the; faciai or 
non-facial region is based on a simple finile siate ma- 
cliine (FS^'l). (The use of FSM-based impiernentailons 
is iwell known to those sitilled in the art.) The PSM nnain- 
tains a "rubber-band" like relationship between the 
quantizers used in the facial and non-facial regions. It 
attempts to keep the facial quantizer below the non-fa- 
cia! quantizer, subject to a desired distance and the larg- 
est allowable distance as may be defined by the stand- 
ard. When the distance becomes too large, the non-fa- 
cia! quantizers are decrea.sed until they get loo close to 
the facial qLiantlzers, at which point the facial quantizers 
are decreased. The FSh'. exits when bolh quantizers 
have reached the tninirnun values, in this case, the se- 
quence is too sinnple Eo be coded even with the smaliesi 
quantizers, without, for example, increasing the frame 
rate. Note that the structure of the abovs-describsd FSM 
is such that a maximum of 2N stats changes can occur 
before the machine exits, where H is the number of 
quantizers in use ("Miich, as described above, may be 
advantageously limited to eight or less). This results in 
a guaranteed upper bound on convergence time. 

A great deal of computet lona! savings may be ob- 
tained by determining the largest coefficient in the pre- 
quantization stage as noted above. For a given quantiz- 
er, if the largest coefficient is N, tiieri it is knowr; that all 
coefficients will bs zero if the quantization siep size is 
larger than N, given that the quantization is performed 
by division with truncation. One advantage of this infor- 
mation is that variable length coding (such as zigzag 
RLA coding and entropy coding, each familiar to thosje 
skilled in the art) does not need to be performed on any 
block whose largest coefficient was smaller than the 
quantization step size. For large quantizers, this implies 
that liltlQ computation will typically need to be per- 
formed. The procedure can quickly converge upon the 
quantizers which begin to Increase the rale beyond the 
minimum. 

The combination of the above-described FSM, a re- 
striction to at most eight quantizers, and the pre-detsr- 
mination of the largest coefficient comblRe to advanta- 
geously reduce the computational requirements oi the 
rate control process in accordance with this second 
lustrative embodimsnt of the present invention. Such an 
efficient implementation allows the procedure to be ex- 
ecuted in real time. 

In addition, since the process of rate control needs 
only to determine the bit rats for each block, and not the 
actual Huffman codes which would be used to code 
them, an efficient method for storing the rate table may 
be employed when coding in accordance with the H.263 
standard. In particular, after quantization, each DCT co- 
efficient is clipped to 16. Careful examination of the H. 
263 table for coding R LA coefficients shows that no H uff- 
man code exists for any amplitude larger than 12. In 
those cases, the RLA token is escape coded, which re- 
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quires 22 bits (independent of the amplitude). Thus, for 
each run, a table with 1 6 entries may be computed, cor- 
responding to the rate for an amplitude with a value from 
1 to 16. Each enin/ either comes from 1ha iHuffman table, 
s if the given run/amplitude pair is Huffman coded, or it Is 
22 for the escape coding case. This table Is advanta- 
geously small and easily accessed, allowing for a further 
speed up of the compulation. 

Figure 10 is a flow diagram which illu.strates how 
<o rate control may be performed in accordance with this 
second Illustrative embodiment of the present invention. 
The macroblocks to be quantized and transmitted tolhe 
decoder are arranged in an M by N grid. Lei MB(i.j) refer 
tothemacroblockinthe i'th rowandthej'th column. Sim- 
's ilariy, iet Qp(i,j) bs the quantizer assigned to macroblock 
N1B(l,i). The rnacroblocks are divided into two groups - 
•nose in ths iBciai region and those in the non-facial re- 
gion. Three additional parameters are also defined: 
FACE Qp, NONFACE Qp, and NEW Qp. An ordered list 
20 of allowable values for these three parameters, is also 
defined. Two restrictions may be advantageously im- 
pased on this list First, each element of the list is an 
allowable quantizer in accordance with the compression 

is arci, vnliic:; ai ! i;) 's\ ms pt:: niitisd And second, the 
compression standard aliow.s any two adjacent macrob- 
locks to have quantizers which are "neighboring" ele- 
ments in the sat, where the required "neighborhood" is 
defined by the standard. For example, in the H.263 

30 standard, the difference in the magnitude of the quan- 
tizers used in two adjacent macroblocks is required to 
be less lhan three. 

The goal of the iiiii;;lra;lve noihod d<3scribed herein 
is 10 assign lo each macroblock a quantizer, Qp(l,j), 

35 which is an element of ihe ordered list of allowable val- 
ues, such that three conditions are met: 

(a) the bit rate required to code the frame using ihs 
assigned set of QpChj) is close to (but slightly above) 

40 some desired target bit rate; 

(b) macroblocks in the facial region have assigned 
quantizers which arc less than or equal to the quan- 
tizers assigrisdiothe maorobiccks In ihe non-facial 

■*5 (c) each region (facia! or non-facial) is either uni- 
formly quarslized, or else the fogion is divided into 
two parts along a single horizontal boundary, and 
each of these two parts is uniformly quantized. 

so The above three constraints define the desired 
"quantization profile" for the given frame (;. a, the image 
to be coded). The illustrative procedure operates by ad- 
justing all of the values of Qp in a single line of inacrob- 
locks at a time, adjusting either the macroblocks in the 
ss facial or non -facia! region only The procedure illustra- 
tively starts with the largest possible value.s of Q.ti.j), 
and then gradually decreases these values unti! ihe re- 
quired bit rate (barely) exceeds the target bit rate. One 
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advantage cf this direction of "attacl«° (as opposed to 
starling frorn a low Qp and working upwards) is that ol 
computationai savings. For very difficult ;o codej frames, 
it is possible that even with the largest ailowed Qp, She 
frame cannot be coded with the available n umber of bits, 
in this case, decreasing the Qp will only make it worse, 
so the rate control procedure can irriniediateiy terminate 
and report th-st the given frame cannot be coded close 
to the target (Or, alternatively, a variable frame rate 
scheme as described above may be employed, thereby 
Increasing the available number of bits.) If, on the other 
hand, the procedure started from the other direction, a 
difficult frame would require the procedure to try every 
value of Q„ until it hit the maximum, before it could in 
fact dsiarrriins that the frame could not be coded with 
the available numbsr of bits. This would require signifi- 
cantly more compulsstion, especially since the frame is 
presumed to be a difficult one. 

For simple frame sequences, howevsr, the illustra- 
tive procedure described herein wili have to perform 
m.any Iterations before getting the Qp low enough 1o 
code the frame above the target. But such easy se- 
quences usually have very few macroblocks which are 
actually coded, and thus the rate control procedure will 
typically operate more quickly on r.uch sequences. In 
addition, easy sequences are also likely to result in more 
computation time being available to complete the coding 
process. Thus, although alternative embodiments of the 
present invention may operate In either direclion, theap- 
proi5ch employed by this second lllijstrative embodi- 
ment as described herein is likely to be more advanta- 
geous In terms of its computational requirements. 

Specifically, with reference to Figure 10, ti";G lllussira- 
five procedure begins with block 601, assigning the 
quantizer having the largest ailowabie quantizer -step 
size to the parameter NONFACE Qp, and in block 602, 
assigning the quantizer having tfje :;ecorici larg(!3l allow- 
able quantizer step size to FACE Qp. in block 603, all 
of the Qp(i,j) values are initialized. In particular, all mac- 
roblocks In the face region have their corresponding Qp 
(l.j) set to the value of FACE Qp, and all macroblocks in 
the non-face region have their corresponding Qp(i,j) set 
to NONFACE Qp. Then, R, the number of bits required 
to transmit the data with the given set of Qp values is 
comipuled. in block 604, this rate Is coiripared against 
th£5 target bit rate If it is already above the target, than 
there is no way to further decrease the rcite (since the 
quantizers are already at their maximum), and the pro- 
cedure terminates. Otherwise, if the rate Is below the 
target, execution continues with block 605. 

In block 605, another variable, regton, is set to the 
value FACE Region takes on two values only - FACE 
or MOKFACE - and it identifies the region which is cur- 

the variable NEVv Qp is set to the quantizer having ine 
third largest allowable quantizer step size. In block 606, 
m and n, two more variables, are set to the values M 
and 0, respectively Variables m and n (together) point 
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to the currently affected macroblock, and In block 606, 
are thereby set to point to the first macroblock in the last 
rowf. 

in block 606, the (m,n)'th macroblock's classiiica- 
iion (face or non-face), Is compared against the value 
of region (which was Initialized to FACE). If the macrob- 
lock is in the identified region, its Qp is set In block 608 
to A/EWQp (which VJ3S Initialized to the quantizer having 
the third smallest step size). Othenwise, it is passed 

<o over. In block 609, n is incremented, thus identifying the 
next macroblock In the row. In block 61 0, n is compared 
with N. It n Is greater than N, the last macroblock In the 
rov,.' has just been examined, and flow continues to block 
61 1. Oihei-wise, block 607 is executed again, this time 

r-5 to process ihe next macroblock. 

in t)lock 511, the rate, R, is updated bassed on the 
change in Op for each rnacroblock in the m'th row Since 
the Qp values in the row have decreased, the rate wili 
have increased. Thus, the rate Is compared once again 

20 against the target bit rate. If it Is above the target bit rate, 
the procedure terminates. Otherwise, In block 61 3, n is 
reset to 0, and m is decremented by one, thereby point- 
ing to the first macroblock in the row above the previ- 
ously processed row. in block 614, m is corripai'ed 

was the first row. if it vva.? i-iot, conti'oi returns to block 
607, and the reduction of the Qp values (and thus the 
increase of the rate) continues. 

When control passes to block 615, all of the mac- 

30 roblocks In a region have had their Qp updated from ei- 
ther FACEQpor NONFACE QpXo NEWQp. At this point, 
these three values are updated. Figure 11 shows an il- 
iuslraiive flow •diagram for performing the update func- 
iior: of block 51 5 Once the update Is complete, m and 

35 n are reset to iine values M and 0, respectively, and the 
process continues. 

Figure 11 shows the update function. The respon- 
sibility of the update function is to determine in 'jvhich 
region to decrease the quantization - face or nonface. 

40 This comprises setting the /•eg/on variable and choosing 
a value for NEW Qp. However, the value of NEW Qp is 
advantageously chosen so that the difference in quan- 
tization values between two adjacent macroblocks does 
not exceed the limit imposed by the compression stand- 

4S ard. 

The procedu.'e begins in block 701, which sets 
.RACE Op to Nt¥/Qp if the iace region was just adjusted, 
and sets NONFACE Opto NEVx' Qp if the non-face region 
was just adjusted. (Note that NEW now represents 

so the quantization pararnetsr used for all macroblocks in 
the region that was just updated.) In block 702, the dif- 
ference between FACE and NONFACE 0^ is com- 
puted. In block 703, if the difference is determined to be 
above a predetermined threshold, then the macrobiocka 

55 In the taoe region have been (too) much more finely 
quantized than those in the non-face region. Thus, the 
non-tace region macroblocks wili have their quantizers 
reduced next. Otherwise, it is more advantageous to de- 
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crease the Qp in the face region, and flow accordingly 
continuGS to block 704. 

In block 704, FACk Oj; is oorripared io the srnaiiest 
quantizer step S!?e it it has, in lad, reached the smaiiest 
value, thefacial region Q„ values cannot be reduced fur- 
ther. In that case, flow continLjes io block 705, where 
NONFACE Qp is compared agains! the minimum value, 
if it, too, has reiached the sniailnst value, then both FACE 
Qp and NONFACE Qp have aiready reached the mini- 
mum values, and no further reductions can take place. <o 
Thus, the procedure terminates. If, on the other hand, 
NONFACE Qp has not reached the smallest value, then 
the non-face macroblocks will have their Op values re- 
duced in the next iteration. 

if, as dsferminsd by block 704, FACE Op has not is 
reached the smallest value, corstrol passes to block 706, 
where the largest value in the ordered list of silowable 
values which is less than FACE is obtained and com- 
pared against NONFACE Qp. It the difference, referred 
to In Figure 1 1 as DQU ANT, Is larger than the standard 20 
allows, then the facial Qp values cannol be reduced fur- 
ther, so the non-facial Qp values are reduced instead. 
Otherv^'ise (i.e., If the difference is allowed by the stand- 
ard), the facial Qp values will be the next ones lo be re- 
duced 

For clarity of explanation, the illustrative embodi- 
ments of the present invention have often been present- 
ed herein as comprising individual functional blocks. 
The functions these blocks represerti may be provided 
through the use of either shared or dedicatsd hardware, so 
including, but not limited to, hardware capable of exe- 
cuting software. For example, these functions may be 
provided by a single shared processor or by a plurality 
of individual processors. Moreover, use of the term 
"processor" herein should not be construed to refer ex- 
clusively to hardware capable of executing softv^are. il- 
lustrative ernbocjimarjt:; rnay cornpriije digital signal 
processor (DSP) hardware, such as ths ATST DSPI6 
or DSPrj2C, read-only memory (ROM) for storing soft- 
ware performing the operations discussed below, and 
random access memory (RAIVI) for storing DSP results. 
Very large scale integration (VLSI) hardware embodi- 
ment-s, as well as cuistom VLSI circuitry in combination 
with a general purpose DSP circuit may also be provid- 
ed. Any and all of these ernbodimenls rriay be deemed 
to fall within the meaning of the word "processor" as 
used herein. Thus, the above-described embodiments 
as well as any other illustrative embodiments in accord- 
ance with the present invention rnay be implemented as 
software oxscufod on either general purpose or special 
purpose hardware processors, or, alternatively, may be 
implemented "directly" in either "off-lhe-shetf" or custom 
hardware (or a combination thereof), which may or may 
not include processors whiich execute software thereon. 

Although a number of specific embodiments of this 
invention have been shown and de.5cribed herein, it is 
to be understood that these embodiments are merely 
illustrative of the many possible specific arrangements 



',Arf"iich can be devised in application of the principles of 
the invention. Numerous and varied other arrangements 
can be devised in accordance with these principles by 
those of ordinary skill in the art without departing from 
the spirit and scops of the invention. 



Claims 

1 . A method of coding an image signal, the image sig- 
nal representative of an image comprising a plural- 
ity of regions, each of the regions having one or 
more corresponding quantization error parameters 
associated therev^ith, the method comprising the 
steps of: 

assigning a value to each quantization error pa- 
rameter; 

computing a coding bit rate for the image signal 
based on the values assigned to the quantiza- 
tion error parameters; 

comparing the computed coding bit rate to a bit 
rate constraint; 

adjusting the assigned value of at least one of 
said quantization erior paratnstors based on 
the coatparison, at leas! one of the quantization 
error parameters corresponding to each of at 
least two of the regions having different result- 
ant values thereby; and 

coding each oi ihc regions b^isedon the values 
35 assigned to tne corresponding quantization er- 

ror parameters subsequent to the adjusting 
step. 

2. The method of claim 1 whereinthecodingstepcom- 
40 prises coding with use of one or more scalar quan- 
tizers and wherein each of the quantization error pa- 
rameters reflects a step size of a scalar quantizer. 

3. The method of claim 2 wherein the assigning step 
■^5 compiises assigriing a rnaxiii-ium value to at least 

one of the (luaritizatior; error parameters, 

4. The method of claim 2 wherein the assigning step 
comprises assigning a minimum value to at least 

so one of the quantization error parameters. 

5. The method of claim 1 whereinthecodingstepcom- 
prises coding each region with a substantially uni- 

6. The method of claim 1 wherein Ihecoding step com- 
prises coding a first portion of one of the regions 
with a first quantization error and coding a second 
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portion of the one of the regions with a second quan- 
tization error, wliarein the first quantization error 
and tiie second quantization error are unequal. 

7. The method of claim 1 wherein the image signal is 
comprised in one frame of a sequence of frames, 
each of tho frames comprising a corresponding im- 
age signal associated Ihssrewith, the method further 
comprising the steps of: 

modifying the bit rate constraint based on the 
comparison step; and 

di!ion to lUe irriags signal, svf-ierair: the one o? 
mote other imago signals are selected for cod- 
ing based on the modification to the bit rale con- 
straint. 

8. The method of claim 1 wherein the adjusting step 
comprises the steps of: 

(a) modifying the assigned vaiue of one of the 
qjanl:/:alion error paramelers: 

(b) computing a modified coding bit rate for the 
image signal based on the values a.ssigned to 
the quantization error parameters subsequent 
to the rn(x!ifying step: 

(c) comparing the computed modified coding bit 
rate to the bit rate constraint; and 

(d) if !hfl filep at compfsrintj the cornpLitsd mod - 
ified coding bii rale to the bit rate constraint 
does not yield a different result than the step of 
comparing the computed coding bit rate to lha 
bit rate constraint, repealing steps (a) through 
(c) one or more times until the step of compar- 
ing the computed modified coding bit rate yields 
a different result than the step of comparing the 
computed coding bit rate. 

9. The method of claim 8 wherein each iteration of the 
modifying step comprises modirylng the assigned 
value of one of the quantization error parartustar!; 
corresponding to a first one of the regions lintll said 
quantization error parameter corrasponciing to the 
first one of the regions reaches a limiting value, and 
wherein at least one iteration of the modifying step 
after said quantization error parameter correspond- 
ing to the first one of the regions reaches the limiting 
value comprises modlf\'ing the assigned value of 
one of the quantization error parameters corre- 
sponding to a second one of the regions. 

10. The method of claim 9 wherein the limiting value of 
the quantization error parameter corresponding to 



the first one of the regions comprises a predeter- 
mined maximum allowable value. 

11. The rrielhod ot claim 9 wherein ihe limiting value of 
5 the quantization error parameter corresponding to 

the first one of the regions co.mprlses a predeter- 
mined minimum allowable value 

12. The method of claim 9 wherein ihe limiting value of 
<o the quantization error parameter corresponding to 

the first one of the regions comprises a value having 
a difference from the value of a quantization error 
parameter corresponding to the second one of the 
regions equal to a predetermined maximum allow- 
<s able difference. 

13. .An encoder for use In coding an image signal, the 
image signal representative of an image comprising 
a plurality of regions, each of the regions having one 

20 or more corresponding quantization error parame- 
ters associated therewith, the encoder comprising: 

means for assigning a value to each quantiza- 
tion error parameler; 

means for computing a coding bit rats for the 
image signal based on the values assigned to 
the quantization error parameters; 

30 a comparator adapted to compare the comput- 

ed coding bit rate to a bit rate constraint; 

mc:;jn.'5 for acjjijsting tti!3 assigned value of at 
L 1 nil. 3 101 error parameters 

35 responsive to ihe comparator, at least one of 

the quantization error parameters correspond- 
ing to each of at least two of the regions having 
different values resulting therefrom; and 

40 a coder, responsive tothe adjusting means, the 

coder adapted to code each of the regions 
based on the values assigned to the corre- 
sponding quantization error parameters. 

■iS 14. The encoder of ciairn 1 3 wherein the coder compris- 
es one or more scalar quantizers and wherein the 
quantization error parameters reflect step sizes of 
the scalar quantizers. 

so 15. The encoder of claim 14 whereir! the assigning 
means assigns a maximum value to at least one of 
the quantization error parameters. 

16. The encoder of claim i4 wherein the assigning 
ss means assigns a minimum value to at least one of 

the quantization error parameters. 

17. The encoder of ciairn 13 wherein the coder codes 



30 



10 



19 EP 0 785 689 A2 

each region with a substantialiy uniform quantiza- 
tion error. 



to the first o 
mined maxi 



le of the regions comprises a predeter- 
num aiiowable value. 



18. The encoder of claim "i 3 wherein the coder compris- 
es means for coding a first portion of one of the rs- 
gions with a first quantization error and means for 
coding a second portion of the one of the regions 
with 3 second quantization error, wherein the first 
quantization error and the second quantization er- 
ror are unequal. 

19. The encoder of claim 13 wherein the image signal 
is comprised in one frame of a sequence of frames, 
each of the frames comprising a corresponding inv 
age signal associated ihorewilh, tho encoder fur- 
ther comprising means for modifying the bit rate 
constraint responsive io ihe eompsrator, and 
wherein the coder codes one or more other image 
signals in addition to the image signal, the one or 
mors other image signals having been selected for 
coding responsive to Ihe modifying means. 



20. The encoder of claim 13 wherein the 
means comprises: 

(a) means for modifying the assigned value of 
one of the quantization error parameters; 

(b) means, responsive to the mociifying means, 
for computing a modified coding bit rate for the 
image signal based on the values assigned to 
the quantization error parameters; 

(c) a con-ip;5.rator adapted to compare the com- 
puted modified coding bit rate to the bit rate 
constraint; and 

(d) means for repeating steps (a) through (c) 
zero or more times until the comparator adapt- 
ed to compare the computed modified coding 
bit rate yields a different result than the compa- 
rator adapted to compare the computed coding 
bit rate. 



23. The encocier of ciairri 2t wherein the limiling value 
of the quaniization error parameter corresponding 

mined minimum allowable value 

24. The encoder of claim 21 wherein the limiling value 
of the quantization error parameter corresponding 
to the first one of the regions comprises a value hav- 
ing a difference from the value of a quantization er- 
ror parameter corresponding to the second one of 
the regions equal to a predetermined maximum ai- 



21. The encoder of claim 20 wherein the modifying 
means comprise!; rns.-ans for rriodifying the as- 
signed value of one of the quantization error param- 
eters corresponding to a first one of the regions until 
said quantization error parameter corresponding to 
the first one of the regions reaches a limiling value, 
and means for modifying the assigned value of one 
of the quantization error parameters corresponding 
to a second one of the regions after said quantiza- 
tion error parameter corresponding to the first one 
of ihe regions reaches the limiling value. 

22. The encoder of claim 21 wherein the limiting value 
of the quantization error parameter corresponding 
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